﻿2026-06-07T22:56:07.3005867Z ##[group]Run cargo test -p spt-daemon --test twohost -- --nocapture
2026-06-07T22:56:07.3006296Z [36;1mcargo test -p spt-daemon --test twohost -- --nocapture[0m
2026-06-07T22:56:07.3018640Z shell: /usr/bin/bash -e {0}
2026-06-07T22:56:07.3018850Z env:
2026-06-07T22:56:07.3019023Z   SPT_TWO_HOST: 1
2026-06-07T22:56:07.3019203Z   SPT_TWO_HOST_ROLE: b
2026-06-07T22:56:07.3019395Z   SPT_TWO_HOST_SECRET: rig-twohost-ci
2026-06-07T22:56:07.3019626Z   SPT_TWO_HOST_PEER_IP: 100.68.35.65
2026-06-07T22:56:07.3019843Z   SPT_TWO_HOST_WAIT_SECS: 900
2026-06-07T22:56:07.3020253Z   SPT_TWO_HOST_NOTIFY_BIN: /home/reavus/actions-runner/_work/spt-core/spt-core/.adapter-notify/target/debug/notify-shell
2026-06-07T22:56:07.3020669Z ##[endgroup]
2026-06-07T22:56:07.5048427Z    Compiling strsim v0.11.1
2026-06-07T22:56:07.5089287Z    Compiling fastrand v2.4.1
2026-06-07T22:56:07.5184865Z    Compiling rustix v1.1.4
2026-06-07T22:56:07.5882272Z    Compiling futures-lite v2.6.1
2026-06-07T22:56:07.5882839Z    Compiling backon v1.6.0
2026-06-07T22:56:07.5966738Z    Compiling darling_core v0.20.11
2026-06-07T22:56:08.0170251Z    Compiling n0-future v0.3.2
2026-06-07T22:56:08.0582679Z    Compiling n0-watcher v0.6.1
2026-06-07T22:56:08.0583082Z    Compiling iroh-dns v0.98.0
2026-06-07T22:56:08.1481661Z    Compiling netwatch v0.16.0
2026-06-07T22:56:08.5590114Z    Compiling darling_macro v0.20.11
2026-06-07T22:56:08.6541992Z    Compiling tempfile v3.27.0
2026-06-07T22:56:08.6798848Z    Compiling darling v0.20.11
2026-06-07T22:56:08.7014421Z    Compiling derive_builder_core v0.20.2
2026-06-07T22:56:08.7689405Z    Compiling portmapper v0.16.0
2026-06-07T22:56:09.1273260Z    Compiling derive_builder_macro v0.20.2
2026-06-07T22:56:09.2545481Z    Compiling derive_builder v0.20.2
2026-06-07T22:56:09.2870483Z    Compiling vergen-lib v9.1.0
2026-06-07T22:56:09.2870912Z    Compiling vergen-lib v0.1.6
2026-06-07T22:56:09.3741821Z    Compiling vergen v9.1.0
2026-06-07T22:56:09.3995679Z    Compiling vergen-gitcl v1.0.8
2026-06-07T22:56:09.5862777Z    Compiling iroh-relay v0.98.0
2026-06-07T22:56:12.1432855Z    Compiling iroh v0.98.2
2026-06-07T22:56:19.6647947Z    Compiling spt-net v0.1.1 (/home/reavus/actions-runner/_work/spt-core/spt-core/crates/spt-net)
2026-06-07T22:56:20.7853802Z    Compiling spt-daemon v0.1.1 (/home/reavus/actions-runner/_work/spt-core/spt-core/crates/spt-daemon)
2026-06-07T22:56:27.1470697Z     Finished `test` profile [unoptimized + debuginfo] target(s) in 19.83s
2026-06-07T22:56:27.1650171Z      Running tests/twohost.rs (target/debug/deps/twohost-fd3f047dfea03eeb)
2026-06-07T22:56:27.1678701Z 
2026-06-07T22:56:27.1678967Z running 2 tests
2026-06-07T22:56:27.1681492Z test two_host_ladder_role_a ... ok
2026-06-07T22:56:27.1688101Z TWOHOST role B: node 9bbcee970607c7454b0baf8b38b032ccdf1a36de7ef04d614158fecd1f08b612
2026-06-07T22:56:27.2975826Z TWOHOST role B: notify instance notify-0 minted (real_mode=true)
2026-06-07T22:56:27.3179248Z TWOHOST role B: drive session 1 ready
2026-06-07T22:56:27.3303133Z PAIR_MEET_UP:twohost step=59362432 id=f9e82770135d904841028524599a291e30ae7a86b07e945f62f3ebee05a60dda addr=EndpointAddr { id: PublicKey(f9e82770135d904841028524599a291e30ae7a86b07e945f62f3ebee05a60dda), addrs: {Ip(100.98.197.12:35367), Ip(192.168.1.154:35367)} }
2026-06-07T22:56:30.3319381Z PAIR_MEET_UP:twohost step=59362433 id=3f32f065b0bf64386cb29d6e91190d0723eb51fa7485d667e8356f15ced14209 addr=EndpointAddr { id: PublicKey(3f32f065b0bf64386cb29d6e91190d0723eb51fa7485d667e8356f15ced14209), addrs: {Ip(100.98.197.12:57093), Ip(192.168.1.154:57093)} }
2026-06-07T22:57:00.3327256Z PAIR_MEET_UP:twohost step=59362434 id=6892fc82e995cde70fbec6a2f16af2f646c8c4ecfcede94e10001f821a0a2e57 addr=EndpointAddr { id: PublicKey(6892fc82e995cde70fbec6a2f16af2f646c8c4ecfcede94e10001f821a0a2e57), addrs: {Ip(100.98.197.12:56436), Ip(192.168.1.154:56436)} }
2026-06-07T22:57:01.2987672Z PAIRED: joiner pinned (Pinned)
2026-06-07T22:57:01.3469379Z TWOHOST OK: pairing: A pinned via the daemon-hosted responder
2026-06-07T22:57:01.3470160Z TWOHOST OK: pairing (responder, daemon-hosted)
2026-06-07T22:57:02.0978396Z TWOHOST OK: register: A's perch row replicated to B
2026-06-07T22:57:03.3537464Z TWOHOST OK: message: A's WAN message spooled at B
2026-06-07T22:57:03.3542147Z TWOHOST OK: notif: A's insert fired on B
2026-06-07T22:57:03.3619458Z TWOHOST OK: notif dismissed at B (bcead52b862344aef51998ca5d8f15dce1e38e6cee3795b219a5849f6ad4b41a:1780873021715) — replicating back
2026-06-07T22:57:03.3724759Z TWOHOST OK: sync: B pulled A's mind
2026-06-07T22:57:03.6228694Z TWOHOST OK: rest: A's remote suspend landed (B suspended)
2026-06-07T22:57:03.8729249Z TWOHOST OK: rest: A's remote wake landed (B active again)
2026-06-07T22:57:27.1681601Z test two_host_ladder_role_b has been running for over 60 seconds
2026-06-07T22:57:30.3335559Z PAIR_MEET_UP:twohost step=59362435 id=481971d251c0d3e84e685d1a355dbeeb973848f5ff3685d7f46df09cca771ac9 addr=EndpointAddr { id: PublicKey(481971d251c0d3e84e685d1a355dbeeb973848f5ff3685d7f46df09cca771ac9), addrs: {Ip(100.98.197.12:55487), Ip(192.168.1.154:55487)} }
2026-06-07T22:57:36.3843267Z PUMP_PEER_FAIL:bcead52b862344aef51998ca5d8f15dce1e38e6cee3795b219a5849f6ad4b41a:stream ended before Done
2026-06-07T22:58:00.3430304Z PAIR_MEET_UP:twohost step=59362436 id=7afcffaea5411d9bbc4e22826fe7a7e5cd3cf5fd6e669ff32aacb6836eecbc39 addr=EndpointAddr { id: PublicKey(7afcffaea5411d9bbc4e22826fe7a7e5cd3cf5fd6e669ff32aacb6836eecbc39), addrs: {Ip(100.98.197.12:47208), Ip(192.168.1.154:47208)} }
2026-06-07T22:58:30.3506213Z PAIR_MEET_UP:twohost step=59362437 id=c79fd4d66752f974fcc24e6721ad0326079569a97f7115f65172f55c9bfef3a8 addr=EndpointAddr { id: PublicKey(c79fd4d66752f974fcc24e6721ad0326079569a97f7115f65172f55c9bfef3a8), addrs: {Ip(100.98.197.12:60816), Ip(192.168.1.154:60816)} }
2026-06-07T22:59:00.3416657Z PAIR_MEET_UP:twohost step=59362438 id=dc12e638eb09c8eb4c5e4650812fae5d8868b7d22c2ce06a08bd6dd9b44f53a8 addr=EndpointAddr { id: PublicKey(dc12e638eb09c8eb4c5e4650812fae5d8868b7d22c2ce06a08bd6dd9b44f53a8), addrs: {Ip(100.98.197.12:36502), Ip(192.168.1.154:36502)} }
2026-06-07T22:59:30.3405742Z PAIR_MEET_UP:twohost step=59362439 id=f0c5afd2160910997f8d030c2f8523f4282e09310850818b43b0d293e45e2455 addr=EndpointAddr { id: PublicKey(f0c5afd2160910997f8d030c2f8523f4282e09310850818b43b0d293e45e2455), addrs: {Ip(100.98.197.12:60739), Ip(192.168.1.154:60739)} }
2026-06-07T23:00:00.3410790Z PAIR_MEET_UP:twohost step=59362440 id=6842b35adc1db1d45ab3a5ad0ef3f4e19a68dfaa6a5978634e9a7d3ea1f4145f addr=EndpointAddr { id: PublicKey(6842b35adc1db1d45ab3a5ad0ef3f4e19a68dfaa6a5978634e9a7d3ea1f4145f), addrs: {Ip(100.98.197.12:39374), Ip(192.168.1.154:39374)} }
2026-06-07T23:00:30.3424446Z PAIR_MEET_UP:twohost step=59362441 id=5472cbe1e0c2db69f0357ec82c33becc8b1cf71ffc3715ad529765d78dc7b738 addr=EndpointAddr { id: PublicKey(5472cbe1e0c2db69f0357ec82c33becc8b1cf71ffc3715ad529765d78dc7b738), addrs: {Ip(100.98.197.12:34335), Ip(192.168.1.154:34335)} }
2026-06-07T23:01:00.3444201Z PAIR_MEET_UP:twohost step=59362442 id=18ca4763a4ea9d680abab5f44aff793657785118ac361639f7e0daf0013c8c12 addr=EndpointAddr { id: PublicKey(18ca4763a4ea9d680abab5f44aff793657785118ac361639f7e0daf0013c8c12), addrs: {Ip(100.98.197.12:38017), Ip(192.168.1.154:38017)} }
2026-06-07T23:01:30.3477651Z PAIR_MEET_UP:twohost step=59362443 id=27c7606de90a866f2747b7560be453dd2f61f6e72916d34b819d2cf5764b2dad addr=EndpointAddr { id: PublicKey(27c7606de90a866f2747b7560be453dd2f61f6e72916d34b819d2cf5764b2dad), addrs: {Ip(100.98.197.12:53121), Ip(192.168.1.154:53121)} }
2026-06-07T23:02:00.3470382Z PAIR_MEET_UP:twohost step=59362444 id=622e83b390d03e8fc86e68fb52e56c6f990fcba12a238c13c1abc13f05ac58d6 addr=EndpointAddr { id: PublicKey(622e83b390d03e8fc86e68fb52e56c6f990fcba12a238c13c1abc13f05ac58d6), addrs: {Ip(100.98.197.12:47227), Ip(192.168.1.154:47227)} }
2026-06-07T23:02:30.3508697Z PAIR_MEET_UP:twohost step=59362445 id=179af6b212e32983c5055cf77f4a598ad78623443e7b3e80ca8e40ead4a43025 addr=EndpointAddr { id: PublicKey(179af6b212e32983c5055cf77f4a598ad78623443e7b3e80ca8e40ead4a43025), addrs: {Ip(100.98.197.12:55967), Ip(192.168.1.154:55967)} }
2026-06-07T23:02:40.0286400Z REGISTRY_EVICT:twohost: 1 row(s) from silent node(s)
2026-06-07T23:03:00.3504056Z PAIR_MEET_UP:twohost step=59362446 id=f62342b7db36c27efb3eaa4f50cad4fc1eb7c62a3baa1ef81e2c31a4db5093b8 addr=EndpointAddr { id: PublicKey(f62342b7db36c27efb3eaa4f50cad4fc1eb7c62a3baa1ef81e2c31a4db5093b8), addrs: {Ip(100.98.197.12:42231), Ip(192.168.1.154:42231)} }
2026-06-07T23:03:30.3499782Z PAIR_MEET_UP:twohost step=59362447 id=dfc0cd8823e54862981dc67dd567116de7654ec9fe3683a602271c7d2fb3be2b addr=EndpointAddr { id: PublicKey(dfc0cd8823e54862981dc67dd567116de7654ec9fe3683a602271c7d2fb3be2b), addrs: {Ip(100.98.197.12:35701), Ip(192.168.1.154:35701)} }
2026-06-07T23:04:00.3522628Z PAIR_MEET_UP:twohost step=59362448 id=874c90902f3212b27865cf84cdc45f60710f6a67a203c3b1c21bd4caafb52716 addr=EndpointAddr { id: PublicKey(874c90902f3212b27865cf84cdc45f60710f6a67a203c3b1c21bd4caafb52716), addrs: {Ip(100.98.197.12:43742), Ip(192.168.1.154:43742)} }
2026-06-07T23:04:30.3531202Z PAIR_MEET_UP:twohost step=59362449 id=0e78e65bcf2065c5e02014d15d0d66761fed1a0cc329d1d8cebe1b0161bbfb7e addr=EndpointAddr { id: PublicKey(0e78e65bcf2065c5e02014d15d0d66761fed1a0cc329d1d8cebe1b0161bbfb7e), addrs: {Ip(100.98.197.12:36601), Ip(192.168.1.154:36601)} }
2026-06-07T23:05:00.3550346Z PAIR_MEET_UP:twohost step=59362450 id=638611b59cb73bf62bd54f559ab36f2ad931c4593924d112bee1032aff4c9997 addr=EndpointAddr { id: PublicKey(638611b59cb73bf62bd54f559ab36f2ad931c4593924d112bee1032aff4c9997), addrs: {Ip(100.98.197.12:44716), Ip(192.168.1.154:44716)} }
2026-06-07T23:05:30.3555853Z PAIR_MEET_UP:twohost step=59362451 id=f4e483c99c16981ec9513887edfdd5c69a5a5654d10469d7ab8d050d5255adad addr=EndpointAddr { id: PublicKey(f4e483c99c16981ec9513887edfdd5c69a5a5654d10469d7ab8d050d5255adad), addrs: {Ip(100.98.197.12:58113), Ip(192.168.1.154:58113)} }
2026-06-07T23:06:00.3581993Z PAIR_MEET_UP:twohost step=59362452 id=447af9beef9bbc64b2b78bab705079b37d06d3b98c00674f46244ae90a45c419 addr=EndpointAddr { id: PublicKey(447af9beef9bbc64b2b78bab705079b37d06d3b98c00674f46244ae90a45c419), addrs: {Ip(100.98.197.12:46392), Ip(192.168.1.154:46392)} }
2026-06-07T23:06:30.3593200Z PAIR_MEET_UP:twohost step=59362453 id=fc0007813625b2273ae217530855e83ce995244cc680706a3931818b6780678f addr=EndpointAddr { id: PublicKey(fc0007813625b2273ae217530855e83ce995244cc680706a3931818b6780678f), addrs: {Ip(100.98.197.12:37365), Ip(192.168.1.154:37365)} }
2026-06-07T23:07:00.3609982Z PAIR_MEET_UP:twohost step=59362454 id=28538bf10fb554296cad34275980f830c09a2f037988af7cf421c1b046f5ebd0 addr=EndpointAddr { id: PublicKey(28538bf10fb554296cad34275980f830c09a2f037988af7cf421c1b046f5ebd0), addrs: {Ip(100.98.197.12:39723), Ip(192.168.1.154:39723)} }
2026-06-07T23:07:30.3622629Z PAIR_MEET_UP:twohost step=59362455 id=441b686cae8d289b1a2a391fd67e3179faab64ef81fd510ba4fd5f648bd5b3b3 addr=EndpointAddr { id: PublicKey(441b686cae8d289b1a2a391fd67e3179faab64ef81fd510ba4fd5f648bd5b3b3), addrs: {Ip(100.98.197.12:39160), Ip(192.168.1.154:39160)} }
2026-06-07T23:08:00.3629528Z PAIR_MEET_UP:twohost step=59362456 id=8624893bed20636c5d15013cc27aaee44f482036fdfaacfa241dd752a448e8d8 addr=EndpointAddr { id: PublicKey(8624893bed20636c5d15013cc27aaee44f482036fdfaacfa241dd752a448e8d8), addrs: {Ip(100.98.197.12:46972), Ip(192.168.1.154:46972)} }
2026-06-07T23:08:30.3633248Z PAIR_MEET_UP:twohost step=59362457 id=3e43694d5497db3877d06e044991c11994496b25fcb2353b98391dd66038a2fe addr=EndpointAddr { id: PublicKey(3e43694d5497db3877d06e044991c11994496b25fcb2353b98391dd66038a2fe), addrs: {Ip(100.98.197.12:37406), Ip(192.168.1.154:37406)} }
2026-06-07T23:09:00.3652343Z PAIR_MEET_UP:twohost step=59362458 id=112c428238e2a881e78bb2bfc4e61772820045953b050abd43714190220b9039 addr=EndpointAddr { id: PublicKey(112c428238e2a881e78bb2bfc4e61772820045953b050abd43714190220b9039), addrs: {Ip(100.98.197.12:38636), Ip(192.168.1.154:38636)} }
2026-06-07T23:09:30.3682402Z PAIR_MEET_UP:twohost step=59362459 id=f235202061506a756bbf05f7476cd2a9d3ccc66febd6c41759f86b961885b3e8 addr=EndpointAddr { id: PublicKey(f235202061506a756bbf05f7476cd2a9d3ccc66febd6c41759f86b961885b3e8), addrs: {Ip(100.98.197.12:41638), Ip(192.168.1.154:41638)} }
2026-06-07T23:10:00.3681447Z PAIR_MEET_UP:twohost step=59362460 id=71d9774f6a23eda3ed08e748056aab8f51d48b6eba50c0cedc496fe363fc5a44 addr=EndpointAddr { id: PublicKey(71d9774f6a23eda3ed08e748056aab8f51d48b6eba50c0cedc496fe363fc5a44), addrs: {Ip(100.98.197.12:42282), Ip(192.168.1.154:42282)} }
2026-06-07T23:10:30.3716043Z PAIR_MEET_UP:twohost step=59362461 id=e9951efab129bf66e6ca4dc2b82122e9e4c17b07b692086576bcc03dd928d0ba addr=EndpointAddr { id: PublicKey(e9951efab129bf66e6ca4dc2b82122e9e4c17b07b692086576bcc03dd928d0ba), addrs: {Ip(100.98.197.12:32843), Ip(192.168.1.154:32843)} }
2026-06-07T23:11:00.3698693Z PAIR_MEET_UP:twohost step=59362462 id=dd2d05c1de447e7ec1b9fd56308e4bd759de1ba07f26ab63316989d68fe72017 addr=EndpointAddr { id: PublicKey(dd2d05c1de447e7ec1b9fd56308e4bd759de1ba07f26ab63316989d68fe72017), addrs: {Ip(100.98.197.12:59283), Ip(192.168.1.154:59283)} }
2026-06-07T23:11:30.3993118Z PAIR_MEET_UP:twohost step=59362463 id=b872209df63a291e0078fa6cba2e6375da273115ff99fc805630251961bded6a addr=EndpointAddr { id: PublicKey(b872209df63a291e0078fa6cba2e6375da273115ff99fc805630251961bded6a), addrs: {Ip(100.98.197.12:41832), Ip(192.168.1.154:41832)} }
2026-06-07T23:12:00.4019449Z PAIR_MEET_UP:twohost step=59362464 id=604ee8244d4916ce9ef88892a289ae845d8cb796755c24b6e52a03ea066bf86d addr=EndpointAddr { id: PublicKey(604ee8244d4916ce9ef88892a289ae845d8cb796755c24b6e52a03ea066bf86d), addrs: {Ip(100.98.197.12:56842), Ip(192.168.1.154:56842)} }
2026-06-07T23:12:03.8774281Z 
2026-06-07T23:12:03.8775221Z thread 'two_host_ladder_role_b' (73984) panicked at crates/spt-daemon/tests/twohost.rs:261:5:
2026-06-07T23:12:03.8777706Z never converged on the rig: presence: A's redirected notif surfaced at B
2026-06-07T23:12:03.8778742Z note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2026-06-07T23:12:03.8893250Z test two_host_ladder_role_b ... FAILED
2026-06-07T23:12:03.8893682Z 
2026-06-07T23:12:03.8894139Z failures:
2026-06-07T23:12:03.8894378Z 
2026-06-07T23:12:03.8894573Z failures:
2026-06-07T23:12:03.8895041Z     two_host_ladder_role_b
2026-06-07T23:12:03.8895446Z 
2026-06-07T23:12:03.8896114Z test result: FAILED. 1 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 936.72s
2026-06-07T23:12:03.8897116Z 
2026-06-07T23:12:03.8942197Z error: test failed, to rerun pass `-p spt-daemon --test twohost`
2026-06-07T23:12:03.9055557Z ##[error]Process completed with exit code 101.
